(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
Internationa] Bureau 



(43) International Publication Date 
22 November 2001 (22.11.2001) 



(10) International Publication Number 

PCT WO 01/87377 A2 



(51) International Patent Classification 7 : A61M 

(21) International Application Number: PCT7IL0 1/00427 

(22) International Filing Date: 14 May 2001 (14.05.2001) 

(25) Filing Language: English 

(26) Publication Language: ^ English 

(30) Priority Data: 

09/57 1 326 15 May 2000 (15.05.2000) US 

(71) Applicant (for all designated States except US): GIVEN 
IMAGING LTD. [TL/IL]; 2 HaCarmel St., Industrial Park, 
20692 Yoqheam (IL). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): GLUKHOVSKY, 
Arkady [TL/IL]; 24/5 Hanuiiot Street, 36790 Nesher 
(IL). MERON, Gavriel BLflL]; 21 Weizmann Street, 
Kfar-Ganim, 49556 Petach Tikva (IL). ADLER, Doron 
DL/IL]; 24/5 Hanuiiot Street, 36790 Nesher (IL). ZINATI, 



Ofra [IL/IL]; 2/3 David Asaf Street, 34760 Haifa (IL). 
AVRON, Jerome [IL/IL]; 36 Holland Street, 34987 Haifa 
(IL). 

(74) Agent: EITAN, PEARL, LATZER & CO- 
HEN-ZEDEK; 2 Gav Yam Center, 7 Shenkar Street, 
46725 Herzlia (IL). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, H, GB, GD, GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP,KE. KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, 
SL, TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU, ZA, 
ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY DE, DK, ES, FT, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

[ Continued on next page ] 



= (54) Title:. SYSTEM FOR CONTROLLING IN VIVO CAMERA CAPTURE AND DISPLAY RATE 



en 



10 




jr.: 



CAMERA 



119 



STORAGE UNIT 



T DATABASE/ ~j 
\ LOOK-UP h- 
\_ TABLE J 



Oil 




IMAGE 
MONITOR 



MB 



IMAGE 
PROCESSOR 



-314 



FRAME 

DISPLAY 

RATE 



FRAME DISPLAY 
RATE CONTROLLER 



FRAME 

DISPLAY 

RATE 



^ (57) Abstract: Systems and methods which vary the frame capture rate of the camera and/or frame display rate of the display unit 
of in vivo camera systems are described. The capture rate is varied based on physical measurements related to the motion of the 
camera. Alternatively, the frame capture rate is varied based on comparative image processing of a plurality of frames. The frame 

f> display rate of the system is varied based on comparative image processing of a multiplicity of frames. Both the frame capture and 
the frame display rates of such systems can be varied concurrently. 



WO 01/87377 A2 lllillllllllMlllBOlilillllflll 



Published: For two-letter codes and other abbreviations, refer to the "Guid- 

— without international search report and to be republished ance Notes on Codes and Abbreviations" appearing at the begin- 
upon receipt of that report ning of each regular issue of the PCT Gazette. 



WO 01/87377 



PCT7EL01/00427 



consecutive frames. 

25. A method according to claim 23 wherein said at least two frames are 
non-consecutive frames. 

26. A method according to claim 23 wherein said step of communicating said 
required frame rate comprises the step of requiring the display of at least one 
frame a predetermined number of times. 

27. A method according to claim 23 wherein said step of communicating said 
required frame rate comprises the step of eliminating the display of at least 
one frame. 

28. An in vivo camera system according to claim 1, and also including an 
antenna array, said array receiving data from said sensor and communicating 
said data to said data processor. 
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SYSTEM FOR CONTROLLING IN VIVO CAMERA CAPTURE AND 

DISPLAY RATE 

FIELD OF THE INVENTION 

The present invention relates generally to an in vivo camera system 
and, in particular, to a system and method for controlling the frame capture rate 
and frame display rate of images produced by such a camera system. 

BACKGROUND OF THE INVENTION 



Several in vivo measurement systems areJ<nown in the art They 
include swallowable electronic capsules which collect data and which transmit the 

15 data to a receiver system. These intestinal capsules, which are moved through 
the digestive system by the action of peristalsis, are used to measure pH 
("Heidelberg" capsules), temperature ("GoreTemp" capsules) and pressure 
throughout the gastro-intestinal (Gl) tract They have also been used to measure 
gastric residence time, which is the time it takes for food to pass through the 

20 stomach and intestines. These intestinal capsules typically include a measuring 
system and a transmission system, where a transmitter transmits the measured 
data at radio frequencies to a receiver system. 

Endoscopes are other types of devices that obtain images from the 
gastro-intestinal tract. There are currently two types of endoscopes. Fiber-optic 

25 endoscopes are pushed through the Gl tract and use a fiber optic waveguide to 
transmit a light signal from the area of interest to electronics located outside the 
patient's body. Video endoscopes place an electronic camera at the area of 
interest and transfer the video data through a flexible cable to electronics located 
externally. 

30 US Patent No. 5,604,531, assigned to the common assignee of the 

present application and incorporated herein by reference, teaches an in vivo 
measurement system, in particular an in vivo camera system, which is carried by 
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a swallowable capsule. In addition to the camera system th re is an optical 
system for imaging an area of the Gl tract onto the imager and a transmitter for 
transmitting the video output of the camera system. The overall system, including 
a capsule that can pass through the entire digestive tract, operates as an 
5 autonomous video endoscope. It images even the difficult to reach areas of the 
small intestine. 

Reference is now made to Fig. 1 which shows a. block diagram of 
the in vivo video camera system described in US Patent No. 5,604,531. The 
system captures and transmits images of the GI tract while passing through the 

10 gastro-intestinal lumen. The system contains a storage unit 19, a data processor 
14, a camera 10, an image transmitter 8, an image receiver 12 (often an antenna 
array), which usually includes an antenna array, and an image monitor 18. 
Storage unit 19, data processor 14, image monitor 18, and image receiver 12 are 
located outside the patient's body. Camera 1 0, as it transits the Gl tract is in 

15 communication with image transmitter 8 located in capsule 6 and image receiver 
12 located outside the body. Data processor 14 transfers frame data to and from 
storage unit 19 while the former analyzes the data. Processor 14 also transmits 
the analyzed data to image monitor 18 where a physician views it. The data can 
be viewed in real time or at some later date. 

20 The number of pictures. that need to be taken and which must be 

analyzed by the attending physician is great Assuming a minimum of two images 
per second and a four to five hour dwell time in the Gl tract, 30,000 images would 
be required during the transit of the GI tract by the capsule. If 20 frames per 
second (fps) are displayed as is standard, the physician would need about 30 

25 minutes to examine the images of the entire Gl lumen. 

PCT Application 99/30610 and Israeli Application 122602 assigned 
to the common assignee of the present application and incorpprated herein by 
reference, recite a method for reducing the number of frames captured by an in 
vivo camera, thereby extending its life. The method discussed in the aforesaid 

30 applications requires disconnecting the camera 1 0 from the power source when 
motion (velocity) is below a certain threshold value. 
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SUMMARY OF THE PRESENT INVENTION 



It is an object of the present invention to provide a system and 
method for minimizing the tim for reviewing images taken by an in vivo camera 

5 system or by endoscopes. This is accomplished by either varying the rate of data 
display and/ or varying the rate of data acquisition. 

In one embodiment of the present invention, an in vivo camera 
system includes an imager which can have its frame capture rate varied. It also 
includes at least one sensor for measuring a physical property relatable to the 

10 motion of the camera system, a data processor for determining a frame capture 
rate after receiving data from the sensor, and a controller for supplying the 
determined frame capture rate to the imager. The sensor can be, among other 
things, an accelerometer, an accelerometer connected to an integrator, a 
pressure sensor, an induction coil, or an ultrasonic transducer. 

15 In another embodiment, an in vivo camera system includes an 

imager which can have its frame capture rate varied, a storage device for storing 
frames captured by the imager, an image processor for calculating the required 
frame capture rate from at least two frames, and a controller for supplying the 
calculated frame capture rate to the imager. 

20 In yet another embodiment of the present invention, a display 

system for displaying the output of an in vivo camera system is described. The 
system includes a frame storage unit for storing frames of the camera system, 
and an image processor for correlating frames to determine the extent of their 
similarity. The processor generates a frame display rate which is slower when the 

25 frames are generally different and faster when the frames are generally similar. 
The embodiment also includes a display unit for displaying the frames received 
from the frame storage unit at the frame display rate. The display system 
described can also include a controller connected to a frame storage unit and the 
imager processor. The controller then varies the display rate of the 

30 aforementioned display unit. In the above embodiment the at least two frames 
can be consecutive or non-consecutive frames. 

In still another embodiment a video camera system also includes a 
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display system having a frame storage unit for storing at least two frames and an 
image processor for determining the similarity of at least two frames. The 
processor generates a frame display rate based on the similarity of the frame. The 
frame display rate is slower when the frames are generally different and faster 
when the frames are generally similar. The embodiment also includes a display 
unit for displaying the frames received from the frame storage at the required 
frame display rate. 

In yet another embodiment an in vivo camera system also includes 
a display system having a frame storage unit for storing at least two frames. The 
display system further includes* an image processor for correlating at least two 
frames thereby determining the extent of their similarity and for generating a 
frame display rate based on that similarity. Finally, the display system includes a 
display unit for displaying the frames received from the frame storage at the frame 
display rate. 

In one embodiment of the present invention, a method is taught for 
varying the frame capture rate of a series of frames generated by an in vivo 
camera system. The method includes the steps of storing the frames in a storage 
device, correlating changes in the details of at least two frames, changing the 
frame capture rate to a predetermined frame capture rate according to the degree 
of change between the at least two frames and transmitting the capture rate to 
the imager. 

In another embodiment, a method is taught for varying the frame 
capture rate of a series of frames generated by an in vivo camera system. The 
method includes the steps of measuring a physical quantity experienced by the 
camera system, converting the physical quantity to a velocity of the camera, 
correlating the velocity with a predetermined frame capture rate, and transmitting 
the predetermined capture rate to the imager. The step of measuring includes the 
step of measuring acceleration, pressure, induced current or motion, the latter 
with an ultrasonic transducer. 

In yet another embodiment of the present invention, a method is 
taught for varying the frame display rate of a series of frames generated by an in 
vivo camera system, the method including the steps of storing the frames in a 
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storage device, correlating changes in the details of at least two frames, and 
transmitting the required frame display rate to a storage device and a display unit. 

Yet a further embodiment of the present invention teaches a 
method for varying the frame display rate of a series of frames generated by an in 
5 vivo camera system which includes the step of repeating the display of a frame a 
predetermined number of times. . 

A similar further embodiment teaches a method for varying the 
frame display rate of a series of frames generated by an in vivo camera system 
which includes the step of eliminating the display of at least one frame. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully 
5 from the following detailed description taken in conjunction with the drawings in 

which: 

Fig. 1 is a block diagram illustration of a prior art in vivo video 
camera system; 

Fig. 2 is a block diagram illustration of a system for varying the 
10 frame capture rate of the camera system of Fig. i using a sensor to determine 
changes in video capsule velocity; 

Fig. 3A is a block diagram illustration of a further embodiment of Fig. 
2 using an accelerometer as a sensor; 

Fig. 3B is a block diagram illustration of a still further embodiment of 
15 Fig. 2 using an accelerometer as a sensor with the control loop and sensor all 
inside the capsule; 

Fig. 4 is a block diagram illustration of an alternative embodiment of 
the system of Fig. 1 in which image data from two consecutive frames is 
compared; 

20 Fig. 5 is a block diagram illustration for varying the frame display 

rate of the in vivo video camera system of Fig: 1 by comparing image data from 

two consecutive frames; 

Fig. 6 is a block diagram illustration of a method for determining if 

the capsule has moved and a change in frame display rate is required; 
25 Fig. 7 are histogram illustrations of a difference function useful in 

understanding the method of Fig. 6; 

Fig. 8A is a block diagram illustration of a method for varying both 

the frame display rate and the frame capture rate as described in Figs. 4 and 5; 

and 

30 Fig. 8B is a block diagram illustration of a system as in Fig. 8A but 

also including a command processor. 

Similar elements in different figures are given identical numbers 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

The large volume of data collected by an in vivo camera system, 
such as the one described above, is a result of the long period of time, usually 
5 several hours, that it takes the camera to traverse the gastro-intestinal tract. The 
camera transits the Gl tract in fits and starts. Because of the intermittent motion of 
the capsule and its long residence time at some positions, the number of 
sequential images that are similar is very large. It would be preferable if such 
duplicative frames were eliminated entirely or at least reduced in number. 

10 Alternatively, the display time of individual frames can be shortened, thereby 
reducing the time required to view the image datastream. The present invention 
describes a number of ways to shorten viewing time: reducing the frame capture 
rate (Figs. 2-4) and/or reducing the frame display rate (Fig. 5). 

It should be understood that in all discussions both above and 

15 below, when the terms camera and imager are used they are equivalent. It should 
also be understood that the camera or imager being discussed in this application 
is one capable of having its frame capture rate and/or frame display rate varied. 

One method to control the frame capture rate is to monitor the 
velocity of the capsule in the GI tract Reference is now made to Fig. 2, which 

20 illustrates, in block diagram format, a system for controlling the frame capture rate 
of the camera 10. The system comprises a sensor 11, a data processor 14, a 
frame capture rate controller 17, a frame capture rate transmitter 16, a capture 
rate receiver 9, camera 10 and optionally, a database or look-up table 15. Camera 
10 and capture rate receiver 9 are both located within the capsule. 

25 Sensor 11, which measures motion directly or indirectly, is attached 

to, or placed within, the capsule 6 and relays the value of a measured 
motion-related physical property to data processor 14. Data processor 14, 
together with database (or a look-up table) 15 to which processor 14. is linked, 
determines the required frame capture rate based on current and past values of 

30 the measured properly. When the camera is moving slowly, fewer frames need to 
be captured; when it moves quickly, the number of frames captured or displayed 
need to be increased. Data processor 14 then provides the calculated capture 
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rate to frame capture rate controller 17, which, in turn, transmits the rate to 
camera 10. For clarity, Fig. 2 (as well as all later Figures) does not show the 
image transmitter 8 and image receiver 12 described above which is the actual 
link between sensor 11 and data processor 14. 
5 In the above embodiment, a database or look-up table is used. In 

other embodiments, database or look-up table 15 is not needed and processor 14 
calculates the required frame capture rate directly using a suitable function. 

Fig. 2 illustrates how the capture rate is transmitted to camera 6. 
Frame capture controller 17 transfers the desired frame capture rate to frame 

10 capture rate transmitter 16. Both controller 17 and transmitter 16 are outside the 
patient's body. Transmitter 16 transmits information about the required capture 
rate to capture rate receiver 9 located within capsule 6. Capture rate receiver 9 
then adjusts the frame capture rate of camera 10. 

A special case of the system in Fig. 2 is illustrated in Fig. 3A where 

15 the sensor is an accelerometer 111 whose output is processed by an integrator 
13. The processor is a motion processor 114. The remaining elements are as 
shown in Fig. 2. Accelerometer 111 js in communication with integrator 13. 
Accelerometer 111, which is typically placed in the interior of capsule 6, 
determines the instantaneous acceleration of capsule 6 as it moves through the 

20 Gl tract. Integrator 13 converts the acceleration data to velocity. Integrator 13 can 
be a stand-alone element connected to motion processor 1 14 (as in Fig. 3A) or it 
can be an integral part of motion processor 114. In either case, integrator 13 
transfers information regarding the velocity of the capsule to motion processor 
114. Motion processor 114, together with database (or look-up table) 15, 

25 determines the required frame capture rate. Processor 114 relays the calculated 
capture rate to frame capture rate controller 17. As described above (Fig. 2), 
frame capture controller 17 relays the required frame capture rate via frame 
capture rate transmitter 16 to capture rate receiver 9 within capsule 6. 

In lieu of database (or look-up table) 15 in Fig. 3A, motion processor 

30 114 can utilize a function that relates velocity to frame capture rate. The function 
can then be used to calculate the required rate. The function, capture rate vs. 
capsule velocity, will usually be monotonically increasing. 
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The small accelerometer 111 used in Fig. 3A can be purchased 
from numerous suppliers. A suitable integrator 13 can also be obtajned from 
many different vendors. Alternatively, an integrator can be built using an 
operational amplifier or implemented numerically using an A/D converter and a 
5 microprocessor. 

In another embodiment, the integrator can be omitted from Fig. 3A. 
In that case, data from the accelerometer 111 can be processed directly to 
determine the required frame capture rate. 

The system in Fig. 1 has been shown and described with 
10 processing and storage units outside the body, but they do not have to be. 
Through miniaturization of the components, most if not all, electronic elements in 
Figs. 2 and 3A above and Figs. 4, 5 and 8 below, can be attached to or placed 
within capsule 6 and in direct communication with camera 10. 

In fact, for the embodiments illustrated in Figs. 2 and 3A, a similar 
15 but alternate placement of components is possible. Referring to Fig. 3B, the 
previous embodiments would have sensor 11 (or accelerometer 111), integrator 
13, data processor 14, and frame rate controller 17 positioned inside capsule 6 
and in direct communication with camera 10. Frame rate transmitter 16 and 
capture rate receiver 9 would then be superfluous. 
20 Other sensors can be used which can determine velocity. A 

pressure sensor attached to the capsule is one such sensor. When the rate of 
peristalsis increases, velocity of the capsule through the small intestine increases. 
A pressure sensor can detect peristaltic induced pressure (and/or changes in 
pressure) exerted by the walls of the small intestine. The relation between 
25 pressure (and/or changes in pressure) and velocity can be determined empirically, 
and then utilized to determine the frame capture rate. 

If the patient is placed in a magnetic field, capsule 6 can contain an 
induction coil which functions as a velocity sensor. The magnetic field induces a 
current in the coil whose magnitude is a function of the velocity of the coil through 
30 the field. Data on the induced current is transmitted to motion processor 114 and 
processed as in Fig. 3A. 

While the sensors 11 discussed with Figs. 2 and 3 above are in vivo 
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sensors and are attached directly to capsule 6, external sensors can also be 
used. A Doppler ultrasound unit continuously tracking the capsule can serve as an 
external sensor. Such a unit would be in communication with motion processor 
1 14 which would "process velocity data and convert it to a frame capture rate as 
5 discussed hereinabove. The conversion of ultrasonic Doppler data to velocity data 
is well-known in the art. Once the velocities have been calculated, a function, 
database or look-up table can be used to define the desired capture rate. 

In yet another embodiment, several physical properties are 
measured concurrently and used to determine an optimum frame capture rate. 

10 This embodiment requires multiple sensors 1 1 , each attached to the capsule 6, or 
possibly, as with an ultrasound sensor, outside the body. Each sensor would 
measure a different property. A data processor 14 or 1 14 as in Figs. 2 and 3, or 
even a set of processors 14, one for each property being measured, interprets the 
data and determines a suitable frame capture rate. The analyses performed by 

15 the several processors are relayed to a central command processor (not shown) 
where their results are combined to obtain an optimum overall frame capture rate. 
The overall optimal rate is then relayed from the central command processor to 
frame capture rate controller 17, which transmits it to camera 10 in a manner 
identical to that described with Fig. 2. 

20 In all of the above embodiments where the velocity of the capsule is 

determined, the conversion of velocity data to frame capture rate does not 
necessarily require the use of digital data. Analog data provided by the sensor 
may be used directly to determine the required frame capture rate if proper 
ancillary analog circuitry is employed. 

25 Reference is now made to Fig. 4 which illustrates another method 

for varying the frame capture rate. Fig. 4 shows camera 10, storage unit 19, an 
image processor 214, frame capture controller 17 and optionally, database or 
look-up table 15. Camera 10 captures a frame that is transmitted as described in 
Fig. 1 to external storage unit 19. Images are stored sequentially in unit 19. The 

30 stored data is comprised of one or more pixel properties. Color and intensity are 
among the properties that can be stored. 

Image processor 214 receives images for comparison from storage 
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unit 19. Processor 214 compares each image l n in the datastream to its 
predecessor l n -i- If the stream of images is too lengthy or rapid, non-adjacent 
images can be compared, e.g image I n with the image ln-k, where k>1. For this 

- latter embodiment, the capture rate_ran J)a calculated „ 

5 k>0. As described below with respect to Fig. 6, the comparison can be made on a 
pixel-by-pixel basis or, alternatively, on a pixel cluster basis. Based on the 
comparison of the two images, processor 214 calculates the required frame 
capture rate. 

Frame capture rate controller 17 receives information about the 
10 required frame capture rate from image processor 214. As shown in Fig. 2 and 
described above, controller 17 transfers the required frame capture rate to 
camera 10. For clarity, the requisite elements for this transfer have not been 
included in Fig. 4 but can be seen in Fig. 2. 

All of the methods discussed above relate to the frame capture rate. 
15 An alternative approach for reducing overall presentation time of the datastream 
of the system is to use a variable frame' display rate. In such situations, the frame 
capture rate can, but need not, be held constant When the analysis of the pixels 
in consecutive frames indicates that the capsule is at rest or moving slowly, the 
images are displayed at a fast display rate. If the analysis indicates that the 
20 capsule is moving rapidly through the Gl tract, the images are displayed more 
slowly. 

Reference is now made to Fig. 5, where a block diagram illustrates 
such a system. The diagram shows camera 10, storage unit 119, an image 
processor 314, frame display rate controller 21, image monitor 18 and, optionally, 

25 database or look-up table 15. Camera 10 transmits frames to storage unit 119. 
After the acquisition of a given number of frames and their storage in the buffer of 
storage unit 119, two consecutive frames P n and Pn-i, are sent to image processor 
314. The frames, either on a pixel-by-pixel or pixel cluster basis, are compared 
using a suitable function or set of functions. The function will usually be 

30 monotonically increasing. Image processor 314, based on its analysis of the 
compared frames, relays the required frame display rate to frame display 
controller 21 . Frame display controller 21 provides the required frame display rate 
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to storage unit 119. The latter releases an image P m or images P m through Pm+p to 
image monitor 18. P m may, but need not be, fram s P n or Pn-i . As discussed 
above, it should be remembered that the frame comparison need not be 
p^rfoiwed betw^ 
k>1. 

The functions used by image processors 214 and 314 in Figs. 4 and 
5 to make their determinations can be based on: 

Calculating the simple difference in a given property between 
corresponding pixels of two, not necessarily consecutive, frames; 

Calculating the cross-correlation function between two, not 
necessarily consecutive, frames; and 

Calculating the changes of local statistical distributions P and 
between corresponding local statistical distributions P in two, not necessarily 
consecutive, frames. 

Local statistical distributions can include the mean, the variance or 
the standard deviation of given pixel clusters. The pixel cluster, for example, can 
be the pixels in the upper left quadrant (64 X 64 pixels) of a 256 X 256 image. The 
above approaches are illustrative only; other approaches may also be used. 

When the image display rate is calculated for non consecutive 
images, Pj and Pj+k, where k > 1, the images Pj+i and Pj+k-1, between the 
non-consecutive images are speeded up or slowed done as determined by the 
display rate calculation for frames Pj and Pj+ X . 

Reference is now made to Fig. 6 where a block diagram of a 
function which can be used to determine the required display rate is illustrated. 
Fig. 6 shows the operations needed for comparing image Pj and Pi+ X , where x is 
usually, but not necessarily, 1. Initially, each image Pi is divided (step 50) into a 
multiplicity of cells Ai(m,n), where 1<m<M and 1 <n<N. 

The average intensity, lAi(m,n) of each cell A(m,n) of image Pj is then 
calculated (step 52) from data provided by image receiver 12. of Fig.1. The 
absolute value of the difference Di(k,l) of the average intensities I of Aj(k,I) and 
A^ x (k,l) of corresponding cells A(k,l) in frames Pj and Pj +X is determined (step 54). 
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Di(k.l) is defined as: 

Di(k,l)= 1 1 Ai(k,o - I ahxOcd| 
It is readily apparent that where Di(k,l) is small, the capsule is moving slowly. 

Thg.-B^jQ values^re then organized-into-a-histogram (step 56)r^e- 

y-axis of the histogram is Di(k,l) and the x-axis is the number of corresponding 
pairs of cells, A(k,I) and Aj+ X (k,l), which have a difference of magnitude Di(k,l). 
Referring to Fig. 7, curve (a) represents a histogram of essentially similar cells in 
consecutive (or non-consecutive) frames, while curve (b) shows a histogram of 
cells in significantly different frames. It should readily be apparent that if two 
images are similar, the histogram of the differences in the cells of these images 
are concentrated at low values of Di(k,l). If the images are different, the histogram 
contains higher values of Dj(k,l). It should also be readily apparent that the center 
of mass CM a of curve (a) is further to the right than the CMb of curve (b) and 
represents a slower moving capsule. 

Returning to Fig. 6, the center of mass CM of the histogram is 
determined in step 58. The CM of the histogram can be correlated (step 60) with 
the velocity bf the capsule by using an empirically determined correlation supplied 
(step 66) by a database or look-up table. On the basis of the CM of the histogram, 
a difference between images is determined and a velocity calculated (step 62). 
The capture or display rate as a function of the difference or similarity in the 
compared images can be provided (step 68) from another empirically developed 
database, look-up table or mathematical function. The capture or display rate is 
then varied (step 64) accordingly. 

Reference is now made to Figs. 8A and 8B, which illustrate yet 
another embodiment of the invention. Fig. 8A shows a combined system where 
both the frame capture rate and the frame display rate are varied concurrently to 
minimize total datastream display time. Fig. 8A is a fusion of the systems shown 
in Figs. 4 and 5. There could equally well have been a combined system of the 
embodiments described in Figs. 2 or 3 and 5. 

In Fig. 8A, two storage units 19 and 119 and two image processors 
214 and 314 are shown. The system also includes frame capture rate controller 
17, frame , display rate controller 21, image monitor 18 and camera 10. One 

14 
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storage unit 19 stores data for the frame capture rate analysis while the other unit 
119 stores data for the frame display rate calculation. Each image processor 214 
and 314 processes a different rate calculation. Image processors 214 and 314 

could use Jhe same or different algorithm s to calcul ate the req uired ca pture and 

5 display rates. 

Fig. 8B is similar to Fig. 8A but contains a command processor 414 
which coordinates and optimizes the capture and display rate calculations, while 
minimizing total presentation time. The command processor 414 receives results 
calculated by processors 214 and 314 and transfers the optimized overall rates to 

10 * capture and display controllers 17 and 21 respectively. 

Currently, data is collected by the video camera at a rate of 2 
frames per second (fps) and screened at a normal video rate of 30 fps. This 
screening rate is too fast for the eye to discern changes and the display rate must 
be slowed. An alternative to slowing down the display rate is to repeat the same 

15 frame several times, displaying the repeated frames at the standard rate. 
Repeating a frame is a way of changing the display rate in cases where it is 
impossible to change the display rate of individual frames directly. Methods such 
as those discussed above, which measure the difference between corresponding 
pixels in two frames, can be used to determine rf repetitive screening of the same 

20 frame is required. Repetition of frames, however, increases the total length of the 
datastream. Therefore, the processor must determine when the trade-off between 
repeating frames and a longer, more time-consuming, datastream is 
advantageous. 

It should be readily apparent, that if the capsule is moving too 
25 slowly, an inordinate number of frames may be identical. If that is the case, the 
frame rate controller, based on the pixel comparisons of the image processor, can 
speed up the display rate by eliminating one or more identical frames. 

It should also be readily apparent that the above-described methods 
for varying frame capture and display rates can be applied to video endoscopes 
30 with little or no modification. 

• It will be appreciated by persons skilled in the art that the present 
invention is not limited by what has been particularly shown and described herein 
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above. Rather the scope of the invention is defined by the claims that follow: 



>. 
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CLAIMS 

An in vivo camera system comprising: 
^imi^erTi^ 

at least one sensor for measuring a physical property relatable td the 
motion of said camera system; 

a data processor in communication with said sensor for determining a 
frame capture rate in response to output of said sensor; and 

a controller for providing said determined frame capture rate to said 
imager. 

2. A system according to claim 1 , wherein said sensor is an accelerometer. 

3 a system according to claim 2, and including an integrator in 
15 communication with said accelerometer for generating the velocity of said in 

vivo camera system. 

4. A system according to claim 1 , wherein said sensor is a pressure sensor. 

20 5. A system according to claim 1, wherein said sensor is an induction coil and 
said in vivo camera system is moving in a magnetic field. 

6. A system according to claim 1, wherein said sensor is an ultrasound 
transducer. 

25 

7. An in vivo camera system comprising: 

an imager having a variable frame capture rate for producing frames; 
a storage device for storing frames captured by said imager; 
an image processor for calculating the required frame capture rate 
30 from at least two frames; and 

a controller for providing said calculated frame capture rate to said 
imager. 

17 
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8. A display system for displaying th output of an in vivo camera system, the 
display system comprising: 

aJ&ame^oj^e^jtJo^ 

5 system; 

an image processor for correlating frames of said output to determine 
the extent of their similarity and for generating a frame display rate 
therefrom, wherein said frame display rate is slower when said frames are 
generally different and faster when said frames are generally similar; and 
10 a display unit for displaying said frames received from said frame 

storage at said frame display rate. 

9. A display system according to claim 8 wherein said at least two frames are 
two consecutive frames. 

15 

10. A display system according to claim 8 wherein said at least two frames are 
two non- consecutive frames. 

11. A display system according to claim 8 further comprising a controller in 
20 communication with said frame storage and said image processor, wherein 

said controller varies said display rate of said display unit. 

12. A system according to claim 1 further comprising a display system 
comprising: 

25 a frame storage unit for storing at least two frames of output of said 

camera system; 

an image processor for correlating at least two frames of said output to 
determine the extent of their similarity and for generating a frame display 
rate correlated with said similarity, wherein said frame display rate is 
30 slower when said frames are generally different and faster when said 

frames are generally similar; and 

a display unit for displaying said frames received from said frame 
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storage at said frame display rate. 

13. An in vivo camera system according to claim 7 further comprising a display 
systemcomprising: ' : 

a frame storage unit for storing at least two frames of output of said 
camera system; 

an image processor for correlating at least two frames of said output to 
determine the extent of their similarity and for generating a frame display 
rate correlated with said similarity, wherein said frame display rate is 
slower when said frames are generally different and faster when said 
frames are generally similar; and 

a display unit for displaying said frames received from said frame 
storage at said frame display rate. 

14. A method for varying the frame capture rate of a series of frames generated 
by an in vivo camera system, the system comprising an imager, the method 
comprising the steps of: 

storing, said frames in a storage device; 

correlating changes in the details of at least two frames; 

changing said frame capture rate to a predetermined frame capture 
rate according to the degree of change between said at least two frames; 
and 

communicating said required frame capture rate to said imager. 

15. A method according to claim 14 wherein said at least two frames are 
consecutive frames. 

16. A method according to claim 14 wherein said at least two frames are 
non-consecutive frames. 

17. A method for varying the frame capture rate of a series of frames generated 
by an in vivo camera system, the system comprising an imager, the method 
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comprising the steps of: 

measuring a physical quantity experienced by said camera system; 
converting said physical quantity to a velocity of said camera system; 

correlating-said-velocity^ 

5 communicating said predetermined capture rate to said imager. 

18. A method according to claim 17, wherein the step of measuring includes the 
steps of measuring acceleration and generating velocity data from said 
acceleration data. 

10 1 

19. A method according to claim 17, wherein the step of measuring includes the 
step of measuring acceleration. 

20. A method according to claim 17, wherein the step of measuring includes the 
15 step of measuring pressure. 

21. A method according to claim 17, wherein the step of measuring includes the 
step of measuring induced current when the camera system is moving in a 
magnetic field. 

20 

22. A method according to claim 17, wherein the step of measuring includes the 
step of measuring the motion of said camera system with an ultrasound 
transducer. 

25 23. A method for varying the frame display rate of a series of frames generated 
by an in vivo camera system, the method comprising the steps of: 
storing said frames in a storage device; 
correlating changes in the details of at least two frames; and 
communicating said required frame display rate to said storage device 

30 and a display unit. 

24. A method according to claim 23 wherein said at least two frames are 
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